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Save earth it's the only planet with chocolate. 
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emana ana uapacity Are uomaing... 

.and your data center is right in the MIDDLE! 
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Economic Impact 
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Greenhouse Gas Emission Trends 




GHG emissions increased 70% from 1970 to 2004 
Energy supply sector rose the sharpest (145%) 



Source: http://www.ipcc.ch/SPM040507.pdf 
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The Drive for Energy Efficiency 
Prepare for Legislation 



US House of Representatives 

> H.R. 5646: To study and promote the 
use of energy efficient computer servers 
in the United States 

EU Commission 

> Energy Efficiency Action Plan to reduce 
energy consumption n100B by 2020 
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Datacenter Power Densities 



What is your current maximum power density per rack? 
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<2kW >2-4 >4-8 >8- 12 >12 -16 >20 - 24 >24 KW 



Most data centers are already 

well past the cooling capacity 

of good raised floors (~4-6kW 

per rack) 



Racks above 12kW are probably 

Blade based, and wiN require 

supplemental cooling 

E.g. - 12kW/200W = 60 Sockets 
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Not enough Cooling for High Loads 





ecommended-H 
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i i r~ 

<68 72.5 77 81.5 > 86 



*Source: Uptime Institute 
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Where Does Data Center Energy Go? 




Switchgear i generator 1*' 
Lighting 1% 
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IT Equipment Power Consumption 
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Percent of BRM Data Center Energy Consumption 



68.05% 




27.46% 



3.97% 



Computers 
Network Gear 
| Storage Device^ 

r~l Unknown 



source: Sun Microsystems 
Jan 2007, 1972 devices 
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Short Term Data Center Energy 
Solutions 

Reduce Computer Equipment Consumption 

EOL Unused Systems 
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Reduce Computer Consumption 

•Why? 

_ 2:1 (or more) payoff 

_ Each watt saved on IT floor = 2 watts not drawn from 
utility 

_ No need to condition, distribute, cool unused watts 

• Strategies 

_ Eliminate Unused Systems 

_ Consolidation 

_ Virtualization 

_ Technology Refresh 
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Eliminate Unused Systems 

• Studies at Sun and another major computer manufacturer 

• Aged servers with no use still in data centers 

• 8%-10% of servers studied had no identifiable function 

_ 150 of 1800 in one study 
_ 354 of 3500 in another study 



_ At Sun, systems were turned off, kept in place 90 days 
_ If no complaints after crossing quarter boundary, removed 



90 days or less to implement 
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Short Term Data Center Energy 
Solutions 

Reduce Computer Equipment Consumption 



Consolidation and Virtualization 
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Join the 880,106 supporters of 
the Stop Global Warming Virtual 
March on Washington DC, and 
become part of the movement to 
demand our leaders freeze and 
reduce carbon dioxide emissions 
now! 



WM Wm J mm* 

Jl 
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Solaris Containers for Virtualization 

Less Servers = Reduced Energy Use 



Strong isolation 
between App 
and System 

Administrators 



OS Virtualization 
built into the kerne 



Very light weight 

and scales with 

any Solaris 

system 



Application 
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Industry Leading Server Virtualization 

Hard Partitions Virtual Machines OS Virtualization Resource Management 
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Multiple OSs 



Dynamic System 
Domains 



Logical Domains 

Xen 

VMware 

Microsoft 
Virtual Server 
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Trend to flexibility 



Datib-ra 
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Single OS 



Trend to isolation 



Solaris Containers 
(Zones + SRM) 

Solaris Trusted 

Extensions 

Solaris Containers for 
Linux Applications 




Server 



Solaris Resource 

Manager 

(SRM) 
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Not All Applications Are Candidates 
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designed, 
human- 
driven apps look 
like this. 
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But Even Tough Apps Can Be Done 



Typical User-Driven Application Usage Profile 




9 virtuaLized servers 
account for 116 
server-hours, a 46% 
savings over non- 

virtualized servers 

(9 x 24 = 216 server-hours) 




4 virtuaLized servers 
account for 57 
server-hours, a 41% 
savings over non- 

virtualized servers 

(4 x 24 = 96 server-hours) 



Each block 
equals 1 
server-hour 



■10.00% 
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Must turn off load balanced servers to 
realize any power savings 
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Consolidation/Virtualization Can Be 
Hard 

• Anecdote from CIO of Bay Area Small-Medium Business 

• "Virtualized my whole environment" 

• Saved $1500 per application instance (no HW purchase) 

• Upon asking for details: 

> Approx. 300 servers was "whole environment" 

> Virtualized -30 servers per month for 12 months 

> 3-5 people working full time on project 





New Vi realization 
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Benefits 

• ROI - $1 .8m (Over 4 year period) 

• ROI model based upon 452 servers 
reduced to 69 (260 in final scope) 

• Cost Savings - $5.4m 

• One time Costs -($1. 6m) 

• On-going Support - ($2.0m) 

• Payback - 1 th Qtr 
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in 3 geographic regions 
Estimated 



Proposed Timeline 
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Phase 1 

_ Project Resourcing 
_ PLC Concept Review 

CAP Plan 
_ Criteria Development 
_ PLC Plan Review 

S10Pre-Work 
_ Perf Data Collection 
_ Profiling 

_ Test Env Upgraded S10 
_ Zones Proof of Concept 
_ Support Model 
_ Dev Consolid Plan, Migr 

Plan, & Update ROI 

PLC Dev & int Review 

Phase 2 

_ PLC Systems Test Review 
PLC Cust. Accept & Deploy 
Review 
Execute Plan 



March April May June July Aug Sept Oct Nov 




Critical Path Item 




Critical Path 
Item 
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Req 



esource 
uirements 



(he numbers 
= headcount equivalents) 



Dev Teams 

Profiling: 7 he for 30 days (CSSIT- 4, DCSIT - 1.75, EFIT - 1.25) 
_ Existing Test to S10: 4.7 he for 90 days (CSSIT-2.6, DCSIT-1.2, EFIT-.9) 
_ Proof of concept consolidation .50 he for 30 days 

ITAS Project planning: 15% for 90 days 

HOPS 

_ S10 pre-work: 2 he for 60 days 
_ Existing Test to S10: 1 he for 90 days 
_ WWDCO Project planning: .15 he for 90 days 
_ WWTS Project planning .15hc for 90 days 
_ DBA planning: .15 he for 90 days 
_ Project Coordination: 1 he for 5 months 
_ Stack Design: 1.5 he for 60 days 
_ Environmental Design: 1.5 he for 60 days 
Profiling & Performance Data Collection: 3 he for 60 days 

ITSM 

_ Program management: 1 he for for 5 months 
Standards Dev & Zones work: 1 he for 90 days 

ITSTAR 

_ Architecture & Sun on Sun support: .50 he for 90 days 
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How Much Can Virtualization Save? 



Sun IT data: 10-25% of 1000+ applications are 
candidates 

Sun IT manages 3500+ production servers globally 

350-875 servers to be virtualized 

1-3 years to complete project 

Final configurations consume one-third to one-half of 
original energy 



8-18% of IT equipment load 
1 6%-36% of total load 



iim hi i 
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Short Term Data Center Energy 
Solutions 

Reduce Computer Equipment Consumption 



Technology Refresh 
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Technology Refresh @ Sun 

■ Colorado campus Sun Ray server upgrade 



Servers Qty Racks K P ™^ 


v880 


22 


11 


617,000 


T2000 


11 


1 


39,000 


Savings 


2x 


lOx 


16x 
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$40K/yr savings in power at the computer 

$80K-$100K including cooling load, power losses 
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Can You Guess What This Is? 
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Newark, CA Consolidation 

202,000 sq-ft reduced to 80,000 sq-ft 
2,200 servers -> 1 ,000 servers 
738 storage devices -> 225 storage devices 
2,200 KW power requirement -> 560 KW 
Compute capacity increased 273% 
Storage capacity increased 373% 
$7.2M capital equipment costs 
$10M construction costs avoided 



Sun 



NEWARK CAMPUS 
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Technology Refresh Savings 

Newer, faster servers allow consolidation 

Minimum two old machines for each new one 

Can be as high as 75% space/energy/cooling savings 

Faster payback because of 2:1 cooling savings 

Build virilization in from the start 

Use Project Blackbox for energy saving and space 
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Project Blackbox Helps Refresh 

• Sun IT planning to use Project 
Blackbox as "Flexspace" 

• Incent application developers to 
deploy in standard HW config 

Custom HW in 3-6 mo 
Flexspace available in 1-2 weeks 

_ Also provides high efficiency 
cooling 






Sun Proprietary/Confidential: Internal Use Only 




>Sun 



Short Term Data Center Energy 
Solutions 

Reduce Computer Equipment Consumption 



Cooling Technologies 



Sun Proprietary/Confidential: Internal Use Only 



>Sun 



Size Of The Cooling Opportunity? 
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Data Center Best 



0.42 



Energy Savings driven by 

reduction in Fan Power (cooling 

system and server) plus Heat 

Transfer efficiency 
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^-Traditional Cooling-^ 
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Liebert Confidential 
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Short Term Solutions 

• Data Center Commissioning 

Sun's Managed Environmental Services 

Detailed inspection and measurement of data center 

Identifies operational problems 

Studies show average 15% building energy savings* 

_ Clogging holes and correct placement of vented tiles 

Can account for as much as 20% of cooling load 
Can be implemented in a matter of weeks 



_ Check data center A/C setpoints 

4% energy for each degree F 



* - Lawrence Berkeley Labs/DOE study of 1 50 
building commissioning projects 
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Medium Term Solutions - Refit 



Rework sections of existing data center for higher density 
Sun examples: 

> IBIS production: Sun's new ERP systems 

> 1500 sq ft 

> 8 x 12 KW racks with in-row liquid 
cooling modules 

> Total project cost $600K 

> 1 weeks from approval to 
commissioned 



Broomfield, CO 
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Trondheim, Norway 



Menlo Park, CA 






APC High Density 

Infrastructure (trn) with 
four Net work Air In-Row 
Computer Room Air Conditioners 

cooling ten NetshelterlT Enclosures 
running at 1 6 Kwatt each plus four 
cabinet* running at 4 Kwatt.. All power 
outlets are remotely controlled and the 
complete system is IP monitored- 



Contact 
Dean.Nelson@Sun.COM 
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Project Blackbox Cooling 

• Air flows in circular path with fans and 
heat exchanger per rack 

• Up to a 60-ton chiller for full 200kW 
load 

• 20% more efficient than conventional 
space 
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Short Term Data Center Energy 
Solutions 

Reduce Computer Equipment Consumption 



Local Power Generation 
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EPA Server And Data Center Energy 



Report to Congress on Server and Data Center Energy Efficiency 

Public Law 109-431 



U.S. Environmental Protection Agency 
ENERGY STAR Program " 



Public Review Draft 



23 April 2007 
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Table 6-1: Energy Cost Savings Comparison for DG CHP in Data Centers 



CHP System 


Molten 
Carbonate 
Fue3 Cell/ 

Chiller 


Phosphoric 

Acid Fuel Cell 

/Chiller 


Microturbine/ 
Chiller Package 


Gas Turbine,' 
Chiller 


Capacity, kW 
Heat Rate. Btu/kWh 
Electric Efficiency, % 
Heat Available for Cooling, 
MMBtu/hr 
Temperature, F 
Cooling, COP 
Cooling Provided, Tons 
Avoided AC kW/CHPkW 
Total Power Generated plus 
Avoided AC, kW 
CHP Efficiency, % 


1,000 
3,060 
42.3% 

1.4 

650 
1.2 
140 

0.14 

1,140 
59.7% 


200 
9,480 
32.6% 

0.37 

250 
0.7 
22 

0.14 

228 
75.0% 


200 
14,300 
23.9% 

1.28 

588 

1.2 

128 

0.83 

366 

68.6% 


3,364 

13,930 

24.5% 

1 9.6 

638 

1.2 
1,960 
0.58 

5,324 

66.3% 


Gas Cost $,'MMBtu 
Average Electric Cost, $/kWh 
Unit Capital Cost S/kW 
O&M Rate, $/kWh 


S7.50 
$0,130 
$7,238 
$0,032 


$7.50 
$0,130 
$7,805 
$0,029 


S7.5C 
SO. 130 
S4,08S 
SO. 022 


$7.50 
50.130 
52.o 1 2 
50.022 


Annual Gas Cost 
Annual O&M Cost 
Annual Avoided Electricity 
Savings 


(5503,065} 
($266,304} 

51,103,497 


(5118.339} 
($48,263} 

S220,756 


($178,507) 
($36,617) 

$354,663 


($2,924,767) 
($615,895) 

S5,1 53,526 


Annual Savings, S 
Annual Savings, S/kvY 


S334,12S 
$334.13 


$54,149 
$270.75 


$139,544 
5697.72 


51,612,864 
$479.45 


Total Capital Cost 

California SGIP 

MT/FC Energy Tax Credit 


S7,238,000 
($2,500,000} 

(51,000,000} 


$1,560,900 
(5500.000} 
(5200.000) 


$817,600 

($160,000) 

(S40,000) 


S7,778 : 200 
(5800,000) 


Net Capital Cost 

Net Unit Capital Cost. $/kW 


53,738,000 
$3,738 


S 360 ,900 
$4,305 


$617,600 
53,088 


56,978,200 
52,074 


Payback, years 

Payback without Incentives 

Net Pavback with Incentives 


21.7 
11.2 


28.8 
15.9 


5.9 
4.4 


4.8 

4.3 
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Data Center News: 



BEMAILTHIS ^LICENSING & REPRINTS 



Solar powered data center wins fans, financial 
benefit 

By Matt Stansberry, News Editor 

13 Dec 2005 | SeaichDataCentei.com 

RSS FEEDS: IT infrastructure news 



E 



| Add to Cj r.l- 



A Romoland, Calif.-basecl hosting data center is now 
completely "green." Phil Nail, the company's data center 
manager and co-founder switched over to solar power in 2001 
and has been tweaking his facility ever since. The investment 
has paid off in low energy costs and an eco-fi iendly marketing 
angle. 

The 2,000-square-foot building from Affordable Internet 
Seivices Online Inc. (AISO), is powered by 120 photovoltaic 
panels generating electricity on ground-mounted platforms 
beside the data center. The power harvested from the solar 
panels is DC and is stored in a battery bank. After it leaves the 
battery bank, the power is converted to AC through Sunny Boy 
inverters from Grass Valley Calif .-based SMA America Inc. 

According to Nail, these panels supply the power to run the 
data center and offices, including the air conditioners. In case 
of an emergency, AISO can get power from its emergency 
generator or the utility grid. 



For more 



Reference Desk 




Data center power 



NEWS, TIPS a MORE 



■ Data center shaves 10% off yearly 
electric bill (ARTICLE) 

■ DC power worries data center planner 
(ARTICLE) 

■ Green data center operations on docket 
for '07 (ARTICLE) 

■ PG&E invests in data center energy 
efficiency (ARTICLE) 

■* VIEW MORE 

VENDOR CONTENT 



Implementing or Upgrading SAP? Don't 
Forget the Data: Addressing the 
Challenges and Risks ... (WHITE PAPER) 



-Progress. 

Actional. 



Download, "S0A Worst Practices 
Volume II: A Look At Governance" 




I> DOWNLOAD.'SOA WORST PRACTICES VOLUME It: 
A LOOK AT GOVERNANCE" 
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Getting to Green 

Do you have teenagers? 
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Short Term Data Center Energy 
Solutions 

Reduce Computer Equipment Consumption 



Organizational Changes 
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Split Incentives - Consumers/Suppliers 

• Many organizations disconnect electric consumption from 
energy budget 

CIO one of largest consumers of energy 
VP of Facilities pays bill 

• Align spending with budget responsibility 

Give CIO electric budget 
Give Facilities IT capital 
Sun's NWK consolidation done with Facilities money 
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Developing Countries - Dumping 
Grounds 



Monitors 8 pounds of lead 

Plastics- flame retardants and 
cadmium 



500 containers enter Lagos, 
Nigeria a month 

> 800 computers per container 
>400,000 systems per month 




The Basel Action Network 
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> 50% enters re-manufacturing 

All metal and plastic recovered 

Less than 5% enters waste 
stream 

Fully RoHS compliant 

Ready for next regs 



European WEEE Directive 

sets target that 65% of IT equipment must be 

recycled* 




*(EC Directive on Waste Electrical and Electronic Equipment (WEEE) and EC Directive on the restriction of 
the Use of Certain Hazardous Substances in Electrical and Electronic Equipment (RoHS) 
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